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13.  AOlTftACT 


’5»The  quality  ot  procurement  actions  conducted  by  the  Department  of  Defense  con  be  enhanced 
by  improving  the  selection  procedure  used  tG  select  procurement  officers.  Such  a  selection  . 
procedure  should  be  baseden  demonstrated  relationships  between  individual  treits  and  back¬ 
ground  and  potential  procurement  performance,  in  this  study,  42  Air  Force  procurement 
officers  who  ‘were  engaged  in  weapon  system  acquisition  were  surveyed  in  an  attempt  to 
'  establish  what  relationships  existed  between  their  procurement  performance,  as  established 
by  supervisors’  ratings,  and  various  psychological  traits  and  biographical  items.  The  contents 
of  this  study  include  a  performance  measurement  device  and  the  statistical  nvethodology  in¬ 
volved,  as  well  os  a  summery  of  the  observed  relationships,  r  - _ 
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Chapter  1 
INTRODUCTION 
Problem  Statement 

Armed  Forces  procurement" personnel  will  obligate  36.4  billion  dollars  in 
Fiscal  Year  1972 }  In  general  two  factors  will  determine  howeffectively  this  money 
will  be  spent".  These  factors  are:  (1)  the  adequacy  of  the  policies  and  procedures 
which  govern  procurement  actta-TX  and  (2)  the  capabilities  of  the  personnel  who  im¬ 
plement  these  actions.  The  Department  of  Defense  has  continually  tried  to  assure 
effective  procurement  Ky  improving  policies  and  procedures.  The  area  of  procure¬ 
ment  personnel  has  not  received  the  emphasis  given  to  policies  and  procedures. 

The  selection  process  is  an  important  step  in  the  development  of  effective 
procurement  personnel.  Effective  selection  requires  systematic  procedures  for  es¬ 
timating  the  future  performance  of  an  individual  on  the  basis  of  available  infor¬ 
mation  at  the  time  of  selection.  This  prediction  is  based  on  observed  relationships 
between  the  performance  of  individuals  and  ihe  traits  and  backgrounds  which  they 
possessed.  It  is  not  known  whether  relationships  exist  between  truits  and  background 
and.procurement  performance.  These  relationships  must  be  identified  before  a 
meaningful  selection  process. can  be  developed. 

Background 

*  Department  of  Defense  Environment 

The  Department  of  Defense  procurement  program  involves  approximately 

12  million  project  actions  a  year.  . .  .For  Fiscal  Year  1968,,  contracts  were 

^ f, ■ s cal  Year  1972-7 6  Defense  Program  an d  I  he  Fiscal  Year  1972  Defen s e 
.Budget  (Washington:  LLS.  Government  Printing  Office,  1971),  p.  189. 
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awarded  totaling  abour"43!»uiion  dollars  for  supplies  and  services. 

The  complex  and  dynamic  Defense  procurement  environment  and 
the  associated  procurement  process  are  characterized  by  a  variety  of 
significant  and  increasinglyserious  problems.  ^ 

The  Report  of  the  Blue  Ribbon  Panel  states  that  solutions  to  these  problems 
fall  into  two  general  categories:  (1)  improvements  in  policies  and  procedures  and 
(2)  improvements  in  personnel .  Past  and  current  emphasis  has  been-on  the  improve¬ 
ment  ofprocurement'policies  and  procedures.  For  example,  the  total  package  pro¬ 
curement  concept  was  an  attempt  to  correct  major  flaws  in  the  procedures  through 
which  weapon  systems  were  acquired.  Another  example  of  the  emphasis  placed  on 
policies  and  procedures  is  evidenced  by  Deputy  Secretary  of  Defense  Packard’s 
memorandum  to  the  services  in  which  he  outlined  five  general  problem  areas  and 
challenged  the  services  to  improve  the  acquisition  process.  The  areas  highlighted 
by  Secretary  Packard  were:  (1)  excessive  optimism  in  cost  estimating,  (2)  control 
of  changes  in  on-going  programs,  (3)  comprehensive  assessment  of  risk  prior  to 
systems  development,  (4)  use  of  competitive  prototypes  in  developments,  and  (5) 
excessive  concurrency  in  development/tesf,  and  production.^ 

The  second  category  of  solutions  deals  with  the  improvement  of  procurement 
personnel.  Members  of  the  Blue  Ribbon  Panel  have  recognized  the  importance  of 
the  second  category. 


^Report  to  the  President  and  the  Secretary  of  Defense  on  the  Department  of 
Defense  by  the  Blue  Ribbon  Defense  Panel  (Washington:  U.S.  Government  Printing 
Office,  1970),  p.  91. 

^Robert  H.  Charles,  "Total  Package  Procurement  Concept . "  Paper  pub¬ 
lished  by  U.S.  Government,  Department  of  the  Air  Force  (Washington:  1966). 

^David  Packard,  Deputy  Secretary  of  Defense:  Memorandum  for  Secretaries 
of  Defense:  Memorandum  for  Secretaries  of  the  Military  Departments,  "Improvements 
in  Weapon  Systems  Acquisition.  "  (Washington,  1969),  p.  2. 
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Regardless  of  how;  effective  the  overall  systems  of  Department  procure- 
.  ment  regulations  may  be  judged  to  be,  the  key  deter  inants  of  the  ultimate 
effectiveness  and  efficiency  of  the  Defense  Procure.'  .ent  process  are  the  pro¬ 
curement  personnel  who  have  the  challenging  responsibility  for  interpreting 
and  applying  the  regulations  and  associated  guidance  material.  The  impor¬ 
tance  of  this  truism  has  not  been  appropriately  reflected  in  the  recruitment; 
career  development,  training,  end  management  of  the  procurement  work 
force.  As  a  consequence,  the  Department  is  faced  with  a  significant  number 
of  immediate  and  future  problems  with  respect  to  the  availability  in  adequate 
numbers  of  appropriately  quatified'and  capable  procurement  personnel.  For 
example,  major  problems  exist  with  respeet  to  ageing,  turnover,  capabilities, 
and  utilization. 

...Improvement  should  be  affected  in  the  acquisition,  training,  and  re¬ 
tention  of  procurement  personnel,  with  emphasis  on  a  promotion  system  for 
contract  negotiators  which  will  not  necessarily  remove  them  from  negotiating 
activities. 

However,  there  has  been  far  more  effort  on  improving  procedures  than  on  improving 
personnel . 

The  major  effort  by  the  Air  Force  in  personnel  improvement  has  been  project 
"COPPERCAP, "  which  is  a  12  point  program  to  improve  the  management  of  the  pro¬ 
curement  career  area.  This  project  is  focused  on  areas  other  than  the  selection  of 
procurement  personnel,  such  as  training  programs,  identification  of  critical  positions, 
improvement  of  promotion  opportunities,  and  career  progression.  The  program  makes 
no  effort  to  selectively  screen  those  individuals  who  enter  the  procurement  field, 
rather  it  emphasizes  the  improvement  and  motivation  of  the  personnel  already  in  the 
Held.6 

Description  of  a  Procurement  Officer's  Function 

An  Air  Force  procurement  officer  occupies  a  staff  position  in  his  organization 


Blue  Ribbon  Panel,  pp.  94-95. 


U.S.  Department  of  the  Air  Force,  Air  Force  Procurement  Career  Devel- 
opment  Action  Plan  -  Project  COPPERCAP,  (Washington.'  Unpublished,  December, 
1970),  pp.  1  -  87. 
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which-  is  analogous  to  a  pusitidriTn  the  purchasing  department  in  a  civilian  corpora¬ 
tion.  In  performing  his  function,  the  procurement  officer  may  contract  for  supplies 
and  services^  determine  the  proper  type  of  contract,  negotiate  new  procurements, 
prepare  and  assemble  contracts,  administer  contracts,  and  review  both  government 
and  contractor  performance.  His  job  .requires  not  only  technical  knowledge  but 
also  the  ability  to  interact  successfully  with  other  persons  both  in  the  government 
and  the  private  sector.  For  example.  Pace,  discussing  contract  negotiations  says: 

. .  .To  be  an  effective  negotiator,  it  takes  dominant  personality  traits 

and  most  of  all,  the  imagination  to  pose  alternatives  or  compromises. 

. .  .But  most  of  all  it  takes  experience,  not  only  by  doing  it  yourself, 

but  by  observing  other  negotiators  in  action.^ 

However,  Mister  Pace  cites  no  empirical  evidence  on  which  he  can  base  his 
opinions. 

Review  of  the  Literature 

A  review  of  the  literature  centered  on  two  areas:  techniques  of  measuring 
job  performance,  and  the  analysis  of  traits  and  biographical  data  as  predictors  of  job 
performance.  Although  a  wealth  of  information  exists  in  these  areas,  no  study  was 
found  which  addressed  itself  to  the  procurement  function.  As  mentioned  previously, 
authors  have  expressed  their  opinions  on  the  subject,  but  no  actual  research  has 
been  completed. 

The  literature  indiccted  that  the  development  of  a  criterion  for  measuring 

7 

'U.S.  Department  of  the  Air  Force,  Classification  of  Officer  Specialty, 
AFM  36-1  (Washington:  U.S.  Government  Printing  Office,  1968),  pp.  A14-35 
through  A14-40. 

8 

Dean  F.  Pace,  Negotiations  and  Management  of  Defense  Contracts  (New 
York:  John  Wiley  &  Sons,  Inc.,  1970),  p.  113. 


job  performonce  becomes  more  difficult  as  the  job  being  measured  becomes  more  com¬ 
plex.  Criterion  measures  have  been  developed  and  used  by  industry  for  measuring 


less  complex  jobs  such  as  typists,  salesmen,  and  assembly-line  workers.  Objective 

output  measures  can  readily  be  developed  for  these  jobs,  for  example,  words  typed 

9 

per  minute,  sales,  volume  per  unit  time,  rejects  per  day. 

Studies  in  the  area  of  predicting  success  in  managers  have  pointed  to  the 
problem  of  developing'techniques  for  measuring  their  performance.^  These 
difficulties  arise  due  to  the  complexity  of  the  manager’s  job  and  to  the  fact  that 
much  of  a  manager’s  work  is  based  on  interpersonal  relationships.  These  same 
factors  are  important  dimensions  of  the  procurement  officer's  job  and  thus  hinder 
the  assessment  of  his  performance  by  objective  output  measures. 

Due  to  the  difficulty  in  establ  isbing  objective  measures  of  a  manager's 
performance,  most  researchers  have  relied  on  a  supervisory  rating  of  one  form  or 
another  as  a  performance  measurement.  One  such  system  is  described  by  Professor 
Wilbert  Steffy  and  Daniel  R.  Darby.  ^  Work  with  supervisory  ratings  has  shown 
that  they  are  subject  to  such  errors  as  the  halo  effect,  that  is  the  tendency  of  a 
rater  to  rate  an  individual  about  the  same  in  all  aspects  of  his  job  because  of  a 
general  overall  impression.  Another  error  is  that  of  a  central  tendency  in  which  a 


Robert  E.  Krug,  "Personnel  Selection"  in  Industrial  Psychology,  ed.  B. 
vor  Haller  Gilmer  (New  York:  McGraw-Hill,  Inc.,  1961),  pp.  108-112, 

John  P.  Campbell  ei  al.  Managerial  Behavior,  Performance  and  Effective¬ 
ness  (New  York:  McGraw-Hill,  !nc.,  1970),  p.  71.  ~~ 

11 

Wilbert  Steffy  and  Daniel  R.  Darby,  Performance  Evaluation  Systems 
(Ann  Arbor:  The  University  of  Michigan,  1969)  pp,  1-34. 
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refer  will  fend  fo  cvoid  extreme  retinas  in  either  direction.  The  literchsre  reveals 

techniques  fo  minimize  thee  errors,  such  cs  a  method  of  rank  order,  paired  cca- 

12 

parison,  and  forced  distribution. 

The  area  of  predictors  of  success  for  a  given  job  hes  else  received  much 

attention  from  industrial  psychologists.  The  earliest  work  in  this  area  was  also  dorse 

for  simple  production  oriented  jobs.  Early  testing  centered  around  general  measures 

of  intellectual  ability  and 'measures  of-sensory  and  psychomotor  abilities.  These 

13 

efforts  have  been  highly  successful . 

The  area  of  predicting  management  performance  has  again  illustrated  the 
difficulty  of  analyzing  complex  Jobs.  Researchers  have  attempted  fo  predict  success 
using  such  traits  as  intelligence,  initiative,  self-assurance,  and  decisiveness.  Pre¬ 
diction  of  management  performance  has  not  been  as  successful  as  that  of  less  complex 
14 

The  literature  also  indicated  several  measurement  devices  which  may  prove 
to  be  predictors  of  procurement  performance.  These  devices  include  personal  history 
analysis,  using  such  information  as  age,  education,  and  experience.  In  addition, 
the  assessment  of  psychological  traits  may  also  be  useful. 

For  example,  Marvin  E.  Shaw  has  developed  a  scale  for  measuring 

^Robert  M.  Guion,  Personnel  Testing  (New  York:  McGraw-Hill,  Inc., 

-  1961),  pp.  97-98. 

13 

Leonard  W.  Ferguson,  'The  Development  of  Industrial  Psychology"  in 
Industrial  Psychology,  ed„  Gilmer,  pp.  19-32. 

^Edwin  F.  Ghiselli,  "Predictions  of  Success  in  Stockbrokers, "  Personnel 
Psychology  XXII  (Summer,  1969),  125-130. 
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Although  she  literature  did  not  deal  specifically  with  the  problem  of  pre¬ 
dicting  procurement  performance,  it  did  provide  essential  background  In  two  major 
areas.  The  first  area  was  the  problems  end  techniques  of  developing  a  performance 
measuring  instrument.  The  second  atea  was  the  development  of  devices  to  measure 
biographical  data  and  traits. 


Scope 


General 

A  concurrent  study  wos  performed  which  was  limited  to  procurement 
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Marvin  E.  Shaw,  "Behavior  in  Groups:  The  Development  of  a  Scale  to 
Measure  Individual  Prominence,"  in  Decisions,  Values  and  Groups,  ed.  Dorothy 
Willner  (London:  Pergamon  Press,  1960)  pp.  149-153. 
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James  E.  Crandali,  "Seif  Perception  and  interpersonal  Attractions  os 
Related  to  Tolerance  -Intolerance  of  Ambiguity,"  Journal  of  Personality  XXXIX 
{March  1969  -  December  1969),  127-140. 


cfficess  ows?  were  cosucSssSsnedi  wsbecss  estogasi  te  the  AssssasEsrsss!  S^tacs  B5w- 
»ca.  Tfsdt  e.  kecs  &  wcs  Eofr  fe2£»!e  o  tes£  a  Sswse  3:000  e?  esc**  jp«*eaxsai£«s- 


offices  fcs&ea  they  eSessd  their  assess  cod  »te>  sdlgsst-gsSly  exccvss  Shea-  psfer- 
scscst,  the  s^hoabSogy  esspJbyesS  ■wes  So  ssassrs  trie  subjects8  traits  end  o=s=b«ce#ce 
ccaawsajly.  Arbst?^SEsd^Boaw=3{|rr5-eB:»yofe»'p«5e2£feES,9»e:£eS5Cse5!03tci' 
a  wide  sesoe  o?  pcs^iisfe. 


AesscicEgiosl  Systems  g>ivis&aa 


Use  Aerasassrical  Systems  Division  is  a  sasjar  eavisjso  of  ihe  Air  ?ons 
Svstesss  Ccacnxd  end  is  located  ef  Y/nghf-Prsteson  Air  ranee  Bass,  Cit&>*  Major 
Gaieral  Lee  V.  Gcssrck,  Ccsnscirg  Gene  re?  c?  ASD  has  sl«es 


_ ASD  is  responsible  for  cresisg  the  cera^ace  !Tan«i  systess  for 

tomorrow's  Air  Force.  In  pursuing  mis  tesk,  me  division  end  iis  con¬ 
i’:  rectors  address  themselves  to  the  whole  renge  c?  ancapion,  devel¬ 
opment,  psJojJKKfii  casd  testing. 

_ Currently,  the  division!  annually  cwcics  awf  6,5DQ  ecntrccis 

ro  ihe  aerospace  industry  —  coraccnies  both  forge  on  small.  These 
contracts  total  more  than  $6  biHioii-  end  represent  ooretler.  half  of 
the  Air  Force  Systems  Commend  (ArSC)  annual  budget.  ^ 

The  officers  included  in  this  study  were  all  involved  in  the  acquisition  or 

Air  Force  weapon  systems. 

ASD  is  organized  into  Systems  Program  Offices  (SPO)  supported  by  func¬ 
tional  offices.  A  SPO  is  responsible  for  the  development  and  acquisition  or  a  specific 
weapon  system  or  subsystem.  The  functional  organization  supports  the 


'LeeV.  Gossick,  Major  General,  USAF,  "Aeronautical  Systems 
Division:  Weapon  Systems  for  Tomorrow's  Air  Force,"  Defense  Industry  Bulletin 
VI  (February,  1970)  p.  15. 
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SPO’s  Ifi  ihs  oceogplegsasfr  off  fchesr  saissjan-  EW  exjispsg-  the  EHrecSocsSe  of 
RrodbcS  czs  csaS  fisegasgagnif  cccsi&s  c?  a  pool  c?  pro€Sfcasies2-  omltgs  who  cssisS  a 
givsSii  S?0  css  seatnred. 

Osjedrhres 

'  Use  pfeay  objective  of  this  thesis  was  So  deter  ssine  if  selsS iosships  exist 
between  gob  jperfossenes  of  Aeoeeuficcl  Syses  Division  peocusecsent  oincas 
end  seiedted  diraerisicsis  cJlheir  traits  end  fccckcnms, 

?n  order  So  %Kis^  the  priasy  objective,  She  following  sdb-objeciives  were 
esidiijs>sd:  0)  c  scale  case  technique  for  cecsunag  job  panocracs  of  procure¬ 
ment  officers  oust  be  developed*  (2|  a  scale  end  technique  for  ceosunng  toils  end 
backgrounds  of  procurement  officers  must  be  developed;  (3)  5 he  infoiraaSfon  gained 
from  ?he  icsoserensenis  previously  described  must  be  analyzed  So  determine  rhe  nature 
of  the  relationship  between  each  toir  end  job  performance. 

Hypothesis  and  Research  Questions 

In  order  to  accomplish  the  primary  objectives,  the  following  hypothesis  wes 
tested,  “The  quality  of  an  individual's  job  performance  can  be  relcied  to  his  biogra¬ 
phical  data  or  his  psychological  traits  or  both.  ” 

This  hypothesis  will  be  examined  by  answering  the  following  research 
question: 

(1)  Can  a  measurement  device  be  developed  which  will  accurately 
measure  a  procurement  officer's  performance,  based  on  a  supervisor's  rating? 

(2)  Is  a  procurement  officer's  performance,  as  defined  by  the  measurement 
device,  statistically  related  to  the  officer's  biographical  data,  that  being  age,  rank, 
length  of  service,  procurement  experience,  educational  experience  and  source  of 
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caaaissicn,  or  to  his  psychological  fecfe  c f  indhioccl  pfcslnence  csx3  felaajcs 


of  cSscgiesscn;? 


(3)  Iso  p/ocuresasat  drri  car’s  penancsios,  as  defined  by  fits  cssoeare- 
Esent  cevj  je.  shnisticclly  related  to  casbinotions  of  his  cisgrcpaicc!  data  cod 
psydsolqcrac.  ccits? 


METHODOLOGY 

Dcic  Collection 

Nshge  cf  tltg  Sample 

There  ate  approximately  1600  Air  Force  officers  in  She  pipcuremeni 
Heidi.  They  ere  assigned  throughout  the  world"  in  various  commands  end  fheir 
widely  differing  tasks  end  responsibilities  radee  coqarijoas  difficult.  Therefore, 
iS  was  necessary  So  limit  this  study  So  a  group  of  individuals  who  belong  to  She 
same  oigoiizoSion  so  that  She  many  other  veri coles  which  effect  jdb  performance 
could  be  minimized.  For  these  reasons.  Air  Force  procurement  officers  cssicned 
to  She  Aeronautical  Systems  Division  were  selected  as  she  subjects  of  this 
study. 

There  are  approximately  110  procurement  officers,  varying  in  rank  from 
lieutenant  So  lieutenant  colonel,  assigned  So  ASD.  Of  these  110,  a  total  of  42 
subjects  were  chosen  in  such  a  way  cs  to  minimize  the  number  of  rcling  super¬ 
visors.  The  sample  consisted  of  all  procurement  officers  assigned  to  five  major 
organizations,  as  shown  in  Table  1.  The  five  organizations,  (A  through  E),  con¬ 
sisted  of  three  systems  program  offices  and  two  functional  departments. 
Measurement  Devices 

The  measurement  of  both  job  performance  and  traits  and  biographical 
data  was  accomplished  with  questionnaire  techniques. 

Criteria  Measurement:  in  order  to  measure  the  perfonnance  of  the 
procurement  officers,  a  rating  scale,  consisting  of  24  items,  was  developed. 

These  items  were  drawn  primarily  from  the  study  conducted  by  Professor  Stefry  and 
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D,  R.  Darby.  ^  The  questions  deal  with  five  major  dimensions  of  a  procurement . 

1  s 

officer’s  job.  Ecch  of  the  category  was  described  Jrr-ferms  of  a  procurement 

* 

officer  whose  past  performance  was  representative  of  me  description  belcw- 


Price: 

The.officer  is  outstanding  in  finding  and  negotiating  = 
the  lowest  price  for  goods. 

Quality: 

The  officer  is- outstanding. in  procuring  goods.of 
high  quality. 

Suitability: 

:  :  !  * 

The  officer  moutsfcnding  in  finding  goods  that  are  “ 
best  su'*-_c  in  terms  of  their  intended  use.  » 

Delivery: 

The  officer  is  outstanding  in  having  his  goods  de¬ 
livered  on  time,  causing  no  problems  with  pro¬ 
duction  or  planning.  i  '  = 

i  * 

Management: 

The* officer  is  outstanding- in  aiding  the  organization  . 

and  his  supervisor  in  the  efficient,  operation  of  the 
organization. 

In  completing  the  rating  scale,  raters  respfonded  by  evaluating  the  sub- 

•  1 

jecfs  on  a  nine  point  rating  scale,  for  each  item.  The  scale  provided  a  rating  of 

i  I 

8  or  9  for  outstanding  performance;  5,  6  or  7  for  superior  performance;  2,  3  or  4 

i 

for  good  performance;  and  0  or  1  for  fair  performance.  A  copy  of  the  questionnaire 

« 

is  included  in  Appendix  A. 

-  i 

In  addition,  each  supervisor  completed  a  performance  weighting  scale  in 
which  he  evaluated  the  relative  importance  of  ..each  of  the  five  dimensions  of  per*'j 
formance.  Each  supervisor  also  rank  ordered,  in  terms  of  job  performance;  all  of. 


^Wilbert  Steffy  and  Daniel  R.  Darby,  -performance  Evaluation  Systems 
(Ann  Arbor:  The  University  of  Michigan,  7961),  pp.  5«34. 

Steffy,  Performance  Evaluation  Systems,  p.  18. 


i 
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the  officers  that.he  supervised..  'Atopy  of  this  instrument  is  included  in  Appendix 


;  Predictor  Measurement:  Trait  and  biographical  data  was  collected  from 

s 

-  *  ^ 

each  subject  by  means  of  the  quesrionnaire  included -in  Appendix  C .  This  question- 

.  3  ; 

mire- included  items  pertaining  io  the  subject’s  age,  rank,  kvngth  of  military  ser- 

!  i  * 

vice,  procurement  experience/  educational  background,,  and  technical  training. 

i  - 

This  questionnaire  also  incorporated  a  24  item  test  which  had  been  de¬ 
veloped  andjValidated  by  Marvin  E,  Shaw.  This  test  measured  each  subject’s 

»  * 

¥ 

-  “individual  prominence,”  defined  as  the  extent  to  which  an  individual  will  attempt 

5  i  j  ’ 

•  3  * 

to  become  tjie  prominent  member  of  a  group. 

*  1  *  : 

This  instrument  also  .incorporated  an  eight  item  test  which  had  been  de- 

veloped  and  validated  by  James  E.  Crandall.^  The  test  was'designed  to  measure  an 

individual’s  tolerance  or  intolerance  of  disagreement.  That  is,  this  test  measures 
•  -  •  * 

the  degree  to  which  an  individual  can  tolerate  open  disagreement  with  others. 

i* 

*  •  : 

Administration  Procedures 

» 

’  » 

.  Each  rater  was  personally  interviewed  by'the  authors  at  which  time  the 

nature  of  the  study  was  discussed.  The  rater  was  asked  to  complete  a  "Job  Per- 

i 

formance  Rating  Scale"  on  each  of  his  subordinates,  and  to  complete  the  "Dimensions 

i  « 

-  J 

of  Procurement"  instrument  and  Jhe  "Overall  Performance"  instrument.  Each  sub- 

1  .  i  , 

-ordinate  was  asked  to  complete  a  "Procurement  Officer  Survey"  form. 


-j  *  , 

Marvin  E.  Shciw,  "Behavior  in  Groups:  The  Development  of  a  Scale  to 
Measure  Individual  Prominence,"  in  Decisions,  Values  and  Groups,  ed.  Dorothy 
Willner  (London:  Pergamon  Press,  1960),  pp.  229-240. 

4  ,  "  ,  j 

,  Crandall,  "Self  Percepfion  and  Interpersonal  Attractions  as  Related  to 

Tojerance-lntolerance  of  Ambiguity,"  pp.  127-140. 
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"  "Data  Analysis 
Organization-of  the  Raw  Data 

Scoring  of  the  Criterion  Measuring  Device:  The  raw  data  provided  by  the 
criterion  measurement- device-consisted  of  the  supervisor's  responses  to  the  24: 
questions  on  the  "Job  Performance  Rating  Scale,"  as  well  as  his  five  responses  to 
the  "Dimensions  of-  Procurement"  instrument.  For  each  subject  this  data  was  scored 
in  two  different  ways. 

Initially,  the  responses  to  the  "Job  Performance  Rating  Scale"  were  aggre¬ 
gated  into  a  raw  score  for  each  dimension  of  procurement.  These  five  dimensions 
and  the  corresponding  item  numbers  are  presented  in  Table  2.  An  individual's  raw 
score  for  each  dimension  was  computed  as  the  sum  of  the  responses  for  that  dimen¬ 
sion/divided  by  the  number  of  responses  for  that  dimension.  That  is,  an  individual's 
raw  score  for  each  dimension  is  the  average  score  he  received  on  all  the  responses 
for  that  dimension. 

In  the  "Dirrensions  of  Procurement"  instrument  the  supervisor  was  asked  to 
express  his  opinion  of  the  relative  importance  of  each  of  the  five  dimensions  of  pro¬ 
curement  by  assigning  a  "percentage"  of  importance  to  each  dimension  in  such  a 
way  that  the  sum  of  the  percentages  would  equal  100  percent.  These  responses  were 
used  to  develop  the  two  different  weighting  factors.  By  converting  these  percentages 
•  to  decimal  fractions,  the  "Individual  Weighting  Factors"  were  computed.  In  addition, 
an  "Overall  Weighting  Factor"  was  computed  for  each  dimension.  Each  "Overall 
Weighting  Factor"  was  calculated  as  the  average  response  of  all  the  supervisors  for 
that  dimension  on  the  "Dimensions  of  Procurement"  instrument. 

Each  subject  then  received- an  "Individually  Weighted  Score"  and  an 


Table  2 


Job  Performance' Rating.  Items. Categorized  by 
Procurement  Job  Dimension 


Procurement  Job  Dimension 

Item  Numbers 

Price 

2,  7,  11,  15 

Quality 

4,  5,  9,  17 

Suitability 

10,  13,  19,  21 

Delivery 

8,  16,  20 

Management 

1,  3,  6,  12,  14 

18,  22,  23,  24 
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“^veralJ  Weighted  Score."  The  "Individually  Weighted' Score  "was  computed.  e$ 
the  sum  of  the  five  average  raw  scores.. times  ihe  respective  "Individual  Weighting 
Factor'*5  for  that  subject.  The  "Overall  Weighted  Score"  was  computed. as  the  sum 
of  the  average  raw  scores  multiplied  by  the  respective  "Overall  Weighting  Factor." 

Thus,  the  criterion  measurement  devices  yielded  two  measurements  of 
performance  for  each  individual:  (1)  the  "Individually  Weighted  Score,  "  and  (2) 
•the  'Overall  Weighted  Score."  The  first  score  for  scch  individual  is  composed 
solely  of  an  individual  supervisor's  opinion  of  the  subject's  performance  in  each 
dimension  and  of  the  relative  importance  of  that  dimension.  The  "Overall 
Weighted  Score"  is  based  on  the  supervisor's  impression  of  the  subject's  job  pe.- 
formance  in  each  dimension,  but  the  relative  importance  of  that  dimension  is  a 
consensus  figure  developed  from  the  opinions  of  all  the  supervisors. 

Scoring  the  Predictor  Measuring  Device:  The  raw  data  provided  by  the 
predictor  measurement  device  consisted  of  cm  individual's  responses  to  the  "Pro¬ 
curement  Officer  Survey"  instrument.  These  responses  included  selected  items  of 
biographical  data  as  well  as  responses  to  the  24  item  test  of  "Individual  Prominence" 
and  the  eight  item  test  for  "Tolerance  of  Disagreement."  The  composition  of  the 
"Procurement  Officer  Survey"  is  shown  in  Table  3. 

Responses  to  the  test  items  consisted  of  a  number  from  1  to  5.  The  score 
for  each  test  was  the  sum  of  the  responses  for  all  the  items  on  that  test,  with  the  re¬ 
sponses  to  negatively  scored  items  reversed.  That  is,  on  negatively  scored  items 
(see  Table  3)  a  response  of  1  was  scored  as  5,  2  was  scored  as  4,  and  so  forth. 

Thus,  an  individual's  score  for  "Individual  Prominence"  could  range 
from  a  low  of  24  indicating  low  prominence,’  to  a  high* of  120.  Scores  for  the 


Table  3 


Composition-, of  "  Procurement  Officer  Survey" 


rrcsvacKxrs  ttzi  cgsyg*;  ^ . 


Predictors 


Item  Numbers 


Biographical  Data 


1  through  10 
(Items  1  through  4  yield 
ordinal ly  scaled  data,  items 
5  through  10  yield  nominally 
scaled  data.) 


Individual  Prominence 


11  through  34 

(Items  14,  15,  18,  21,  28, 
31,  33  scored  negatively) 


Tolerance  of  Disagreement 


35  through  42 

(Items  36,  39,  40,  42  scored 
negatively) 


'Tolerance  of  Disagreement'  test  could  range  from  a  low  of  8  to  a  high  of  40, 

•with  a  low  score  indicating  tolerance  of  disagreement  and  a  high  score  indicating 
intolerance  of  disagreement. 

Statistical  Analysis 

Scales  of  Measurement:  The  analysis  of  statistical  data  is  dependent  upon 
the  scale  of* measurement  of  the  data.  Biographical  data  such  as  type  of  degree, 
source  of  commission,  undergraduate'  m'a  jor  and1 current  enrollment  in  a  college 
course  are  clearly  nominal  in  nature.  Other  biographical  data  such  as  age,  rank, 
yeare  of  service,  years  of  experience  in  procurement,  and  total  number  of  pro¬ 
curement  courses  attended  are  clearly  ordinal  in  nature  if  not  in  fact  interval . 

The  data  generated  by  rating  scales  is  variously  treated  as  ordinal  or 

.  interval  data.  However,  Gniselli  has  outlined  a  number  of  reasons  to  treat  data 

5 

gathered  in  this  way  as  interval  in  scale.  Therefore,  dcta  such  as  individual 
prominence,  tolerance  of  disagreement,  individually  weighted  performance  score 
and  overall  weighted  performance  score  were  treated  both  as  ordinal  data  and  as 
interval  date.  Statistical  inferences  which  are  based  on  the  assumption  of  ordinal 
scale  of  measurement  are  therefore  conservative.  Treating  this  data  as  interval 
in  nature  allows  the  use  of  much  more  powerful  statistical  tools. 

Analysis  of  Criterion  Measurement  Devices:  In  order  to  answer  the  re¬ 
search  question,  "Can  a  measurement  device  be  developed  which  will  accurately 
measure  a  procurement  officer's  performance,  based  on  a  supervisor's  rating?". 


Edwin  E.  Ghiselli,  Theory  of  Psychological  Measurement  (New  York: 
McGraw-Hill,  Inc.,  1964),  p.  131. 
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the  measurement  instrument  was  analyzed  with  respect  fo  validity  end  refer  bios. 

The  measurement  device  can  be  considered  to  he  valid  if  the  scares  it  pro¬ 
vides  reflect  the  rater’s  rank  ordering  of  the  subject’s  performance.  There  were  two 
instances  in  the  sample  where  one  supervisor  rated  more  than  five  subjects.  Each 
supervisor  performed  a  fcrced-dhoice  rank  ordering  of  the  individuals  he  rated 
(Appendix  B).  These  rankings  were  compered  both  fo  the  individually  weighted 

performance  scores  and  to  the  overall  weighted  performance  scores  through  the  com- 

■% 

<r 

potation  of  a  Spearman  Rank  Correlation  Coefficient.  The  strength  of  these 
correlations  indicated  the  accuracy  of  the  measurement  device. 

The  comparison  of  performance  scores  provided  by  the  different  raters  is 
based  on  the  assumption  that  each  rater  would  rate  a  given  individual  the  seme  if 
given  the  opportunity.  However,  this  is  not  always  the  case.  This  type  of  rater 
bias  has  been  described  as  "leniency.”  That  is,  iome  raters  will-  tend  fo  rate  ali 
individuals  relatively  high  while  other  raters  tend  fo  rate  all  individuals  relatively 
low.  To  determine  the  extent  of  rater  bias,  a  Chi-Square  test  for  independence 
was  performed.  If  there  was  no  rater  bias  present,  each  rater  would  be  expected 
to  rate  half  his  subjects  above  the  median  performance  s<:are  and  half  below.  Di¬ 
vergence  from  this  pattern  an  be  attributed  either  to  rater  bias  or  fo  the  fact 
that  his  subordinates  were  in  fact  superior  to  the  group  as  a  whole.  Since  officers 

^Sidney  Siegel,  Nonparametric  Statistics  for  Behavioral  Sciences,  {Nev/ 
York:  McGraw-Hill,  Inc.,  1956),  pp.  202-5*13^  “ 

^Robert  M.  Guion,  Personnel  testing,  (New  York:  McGraw-Hill,  Inc., 

1965),  pp.  99. 
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Siegel,  Nonparametric  Statistics,  pp.  42-47. 


os  assigned  to  AS5J  one  cf  a  SEses  css  vbcssscBes  eccur,  gek3  since  no  ershrit  is  p-tV 
to  cauce^^s  superior  pesstasl  35  esayspscsitc  deparitsasci,  if  is  oxf  cnitbly 
•ha.  toe  medics  sertcsraaacescRne  tor  cny  sizable  dssertiss nf  ■aould  differ  frees  She 
ovsraii  group  ssdks;.  Tbcs  css y  signiiscsssf  ciirs.'SKSS  sen  be  dtobtsd  to  isfer 
kies. 

In ec&r to  ccsred ^fean-ca  scare,  forpassibls  nserbss,  are  ccjisrsd 
penbnamce  scans  vks  cgirefed  for  subjects  whose  sspesvisess  refed  three  or 
roc-re  ssjeds.  An  ovesall  overoce  score  kcs  ccs^cteef  cs  tel!  as  ike  overage 
fowe  assigned  hy  ecdi  supervisor.  The  ciifetsscs  between  ntse  r«o  messes  wgs 
then  added  to  each  persbrnsence  score.  For  exrzspfe,  if  the  overall  cvercgg 
score  were  70,  end  the  average  score  assigned  by  o  specific  supervisor  were  SO, 
then  a  subject  scored  hy  that  supervisor  who  hod  o  score  of  72  would  have  cn 
adjusted  score  cf  82.  since  92  -r  (  70  -  8£}  --  82. 

Analysis  of  Nominal  Pete:  |r  o  specific  i'era  of  nominally  scaled  b  jo- 
graphic'll  data  was  net  referred  to  cn  individual'*  perfcr^-once,  then  half  of  the 
subjects  in  any  given  category  would  be  expect  ed  to  score  oboye  the  median  in 
perfon«-ance  and  half  below.  The  Chi-Square  test  was  performed  for  each  of  the 
four  items  to  determine  the  significance  o?  the  reserved  patterns. 

Analysis  of  Qrdfngl  Data;  The  assumption  of  ordinal  scaling  permits  a 
funk  ordering  of  the  subjects  in  terms  of  the  performance  scores  and  indivioual 
prominence  scores,  tolerance  of  disagreement  scores  and  ordinally  scaled  bio¬ 
graphical  data.  ;f  u  trc’t  or  biographical  item  were  related  to  performance,  then 
it  would  be  expected  that  the  rank  ordering  of  the  subjects  in  terms  of  performance 
y.'Cuid  be  similar  to  their  yank  ordering  in  terms  cf  rhe  predictor  measurement.  A 
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SpeonsGsi  BtdS:  Gxrelcf  Bon  £aessics&£  vss  cxzpsfsd  fc»  t&izsvrs  S5ae  degree  of 
sSsaaEociiy  beSweera  Sbe  Eodkcngs,  and  berxs  Sse  sS-ie^gib  e?  tbs  refesnbcarsipc  be- 
in* «S3  caSesic;  cal  pcecSeSoss. 

Aaslysis  of  LtkvcI  Date:  Tbs  csaaafiBca  of  irfsrvcl  seeling  clb»s  See 

9 

cc£a  So  be  plbsred  ca  cc ordScese  gxss.  I?ne  le2*r  scscs-es  linear  csgresaoc  was 

penbreasd  gci  «*■  dh  ioServcIly  seeled  psedicSor  So  deSeagane  She  sxsexe  and  exzes£ 

o?  Sbe  relcair*  snip  bssrweea  SibcS  predirfoir  esc S  pesfonsancs  scares.  GoeelcsSiss 

coemcienss  were  ededsed  So  ceSecalne  Sbe  shrasagSlbs  of  Sfae  Eekdtansbips. 

In  osder  to  eserpe-re  Sne  individoalSy  weigbSed  and  cveroi I  wesdhied  per- 

■hnaonce  scores,  a  repression  enslysis  «cs  cko  pesfbaned  cn  Sr=e  S%c  scores.  To 

dsSencbe  if  p®3:cfor  ties  were  insiepen&sr  cf  cse  cnaikr,  regression  cralyas 

«ffi  penosjd  bef*saj  Sne  vctsks  preddos.  Finally,  c  reulriple  regression 

.10 

dialysis  vies  perforrsed  cn  Sne  perfonwsace  measures  and  Snose  predictors  v.bicn 
were  raosr  srcngiy  relaxed  So  perfonacnce. 


%.  J.  Williams,  Regression  Analysis  (Nsy*  York:  John  Wiley  &  Sens, 
Inc.,  1959),  pp.  10-22. 


10..,. 


Williams,  Reg-ession  Analysis,  pp.  23-59. 
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?es  1TCCSC  xcst&ssssxesseat 

lbs  *0?fiesE31  Wgaghgibg*  Sscfcss  wbcds  wsse  cdlajlbSsd  rhra  fie  *D3- 
ggaaocscf  gtecsssmest”  gjjacaaJ  are  gsesaefes  ;n  Table  4.  These  fee-fees  were 
cssd  :a  caJcalcricg  fie  "Overall  Weigpfed  .Scare.®  loess  codecs,  which  escsesent 
fie  consesssis  eS  cpraScci  of  ell  fie  ssapesvisScs  iswdhred!  in  fie  siaejy,  dSescsEszrsrfe 
fid  °^»ioe®  «cs  icesrifsed  cs  fie  esc*?  iapericsit  chassrslcci  dr  pracuceraesriL  bat 
ir  sncUd  also  be  rated  fid  sx>  specific  dissension  was  Isolated  cs  being  eifi-r  pora- 
nocG^  in  bsatence  csr  cs  being  leloSvely  vohzpcsf&of. 

The  psnonsRce  scores  of  ell  subjects  cce  incited  in  Appendix  D.  Ad- 
Justed  scores  were  calculated  for  only  those  s&jecis  wfscse  supervisees  rated  three 
or  nacre  subjects;  thus  djusid  scores  were  calculated  for  only  29  of  fie  42  sub¬ 
jects.  These  scores  ore  sunxsanzed  in  Table  5. 

Tcbie  5  also  includes  fie  results  of  fie  analysis  of  rarer  bias  for  each  per¬ 
formance  measure.  The  Chi-Square  test  for  independence  yielded  a  significance 
level  which  estimated  fie  probability  of  obtaining  fie  observed  distribution  of 
scores  if  there  v/ere  no  rater  bias  present.  Therefore  a  small  significance  figure 
strongly  indicates  fie  presence  of  rater  bias  in  fie  measurement.  It  can  be  seen 
in  Table  5  fiat  fie  adjustment  procedure  did  not  appreciably  affect  fie  means  of 
fie  individually  weighted  or  overall  weighted  scores.  However,  fie  range  and  fie 
standard  deviation  of  those  scores  was  considerably  reduced  by  fie  adjusted  pro¬ 
cedure. 

The  Spearman  rank  correlation  coefficient  between  supervisors'  impressions 


Tdbl a  4 


Ovescll  Waiting  Fedots  dbsihsd! 
feaa  “Bssscsksss  of  Rnsaacssesi” 


DktKJCn 

Average  Wesg^jf 

Price 

- 

30% 

Qualify 

13% 

Sutfdbiiify 

17% 

Delivery 

14% 

Mcnacexrisnf 

22% 

Total 


10D% 


StesiSricd  Scraraarycc 
PessbcBcnce  Sexes 


Sefrigiss  _ steigasa race  Scares 


bJwaxHy 

WdejaSed 

OvssbII 

Wekfc&ea 

A%5?ed 

isaSvxSssIIy 

Vftsigj&Sed 

Aajp&ed 

QvszdM 

WeignSedl 

lfeS23 

69.99 

67.m i 

69.89 

67.70 

Sronecxc! 

Deviation 

13.22 

10.94 

7.82 

4.63 

Minfcaura 

27.03 

45.09 

53.09 

56.09 

tectaoa 

87.09 

82.03 

83.09 

82.09 

Si^iiHccnce 
level  of 

Rarer  Bits 

.005 

.095 

.50 

.75 

Bote:  Sample  size  is  42  for  the  Individually  and  Overall  Weighted 
scores  and  24  for  the  Adjusted  scores. 


cad  {Sag  Sasibfidbally  wdcpfed  pegfoarcgace  spbcss  was  .845.  The  Speanscca  rarfc 
CCTrdbiksQ  cossfeclr-’®- between  sapesvfes^  Eacsesscas  cod  the  cwessSS  weSgsfed! 
pssSxsseraos  ssscs  was -.912.  AcscisSe^icracc^isae^cferivsdfinocaop^ssssisas 
of  t&e  Ecdhdebzlly  weights:"  perfccacccs  sscses  fes  toe  cversdl  weighted  pesfccaecace 
was  -927-  All  ferae  dF  feese  careScSores  were  significant  eta  level  dr  -CSS  ctr 


neSsr.  Isis  endicctes  Shot  a  nd:  ccdssing  dr  iraSvidtacSs  according  fes  sccesvssces? 
isseesssans,  for  example,  is  vesy  socaEcr  fes  a  ranfe  cederrbg  of  IsasSwEdsak  according 
So  fee  fsdfviicbally  weighted  pesfocseacs  saxes.  The  agamcanae  level  Indicates 
feet  rank  ccderlrcs  os  szcllor  os  feese  wccSd  be  ccsesved  no  core  feca  cace  in 
2,000  trials  if  fee  ©rdess  were  in  fee-  naadca  end  Independent. 

Analysis  of  Moolncl  SVedicfear  Bate 

NcciieI  credScfcr  dbfes  Induced  {be  highest  ccoasalc  c-egrea  feat  each 
subjed  held,  bis  un&sroiraK  ncjcr  field  of  s tedy,  his  airent  ejuollDeni  sfehss 
in  a  college  level  coarse,  end  his  source  of  axsnissicn.  Analysis  or  {his  data  was 
based  cn  {he  Individually  weipirsd  psifcraonce  scores.  The  rests! is  of  these 
analyses  ere  presented  in  Tc&les  6  through  9. 

The  subjects'  responses  to  his  highest  acodemlc  degree  held,  as  shown 
in  Table  6,  were  so  varied  thaf  an  analysis  could  not  be  performed  which  con¬ 
sidered  each  individual  category.  Therefore,  the  categories  v/ere  combined  into 
baccalaureate  and  advanced  degrees.  The  category  entitled  "Other  Advanced 
Degrees”  included  subjects  who  held  degrees  in  law  and  specialized  masters  de¬ 
grees.  The  significance  level  determined  from  this  analysis  indicates  that  the 
probability  of  obtaining  the  observed  distribution  of  scores  if  there  were  no 
difference  in  the  mean  performance  scores  of  individuals  with  advanced  and 


Table  6 


Note:  The  distribution  oflTotal  Bachelor  add  Total  Advanced  degrees  Is  significant  at  the  .IS  level,, 
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_ Table' 8 

Categorization  of  Procurement  Officers;by  Above  and  Belov/  Average 
Performance  and  by.  Current  Enrollment  in  a  College  Course 


Performance 

’ 

Enrollment 

Undergraduate 

Course^ 

Graduate 

Course-- 

Not 

Enrolled 

Above  Average 

0‘ 

4 

17 

in  Performance 

Belcv/  Average 
in  Performance 

2 

2 

17 

Totals 

2 

6 

34 

I 


Table  9 


Categorization  of  Procurement  Officers  by  Above  and  Btelow  Average 
Performance  and  by  Source  of  Commission 


r 

Performance 

Source  of  Commission 

Reserve  Officer 
Training  Corps 

Officer  Training 
School 

Service 

Academy 

Above  Average 
in  Performance 

12 

6 

3 

Below  Average 
in  Performance 

11 

8 

2 

Totals 


23 


14 


5 


bachelor  deal  ses  was.  .15. 

The  undergraduate  majors  reported  by  the  subjects  were  also  distributed 
among  many  categories  as  shown  In  Table  .7.  For  purposes  of  analysis,  therefore, 
these  categories  v/ere  combined  into  ‘’Business  Related  Major"  arid  "Non-Business 
Re-fated  Major,"  where  business  related  majors  included  the  categories  of  Business, 
Accounting,  Marketing,  and  Economics.  A  significance  level  of  .75  was  thus 

achieved,  that  is,  observations  such  as  these  could  be  expected  in  3  out  of  4 

V. 

trials  if  in  fact  the  average  performance  of  individuals  with  business  majors  was 
equal  to  the  average  performance  of  individuals  with  non-business  majors. 

Subjects’  responses  to  current  enrollment  in  academic  courses  and  to 
source  of  commission  are  summarized  in  Tables  8  and  9  respectively.  The  fre¬ 
quency  of  responses  observed,  in  each  category  for  both  of  these  items  indicates 
that  there  is  no  significant  difference  in  the  performance  of  the  subjects  based 
upon  these  categorizations. 

Predictor  Measurement 

The  responses  to  the  "Procurement  Officer  Survey"  instrument  are  in¬ 
cluded  in  Appendix  E.  Thera  were  so. few  responses  to  item  number  5,  "Types  of 
Procurement  Assignments, "  i.e.  Base  or  Depot  Level  assignments,  that  this  item 
could  not  be  meaningfully  evaluated,  and  It  was  therefore  not  included  in  the 
results.  These  responses  are  summarizedin  Table  10. 

Correlation  of  Predictor  and  Performance  Measurements 

Analysis  of  the  results  based  on  the  assumption  that  the  performance  scores 
were  rjrdindly  scaled  data  precludes  the  use  of  the  adjusted  performance  scores 
since  the  adjustment  procedure  was  based  on  the  assumption  that  these  scores 


Statistical  Summary  of  Predictor 
Responses 


Statistics 


Predictor  Responses 


Age  Years  of  Years  in  Technical  Individual  Tolerance 

'Military  Procurement  Training  Prominence  of 

Service  Field  (total  Disagreement 

courses) 


Mean 

28.70 

6.70 

3.50 

.80 

58.60 

20.70 

Standard 

3.85 

4.38 

2.70 

.97 

8.54 

3.94 

Deviation 

Minimum 

23 

1 

1 

0 

36 

12 

Maximum 

35 

14 

10 

4 

77 

29 

werelnterval  in  5c ale.  The  observed  correlations  between  the  ordinally  ranked 
predictor  data  and  performance  scores  ere  shown  in  Table  11 .  As  can  be  seen 

* 

from  ihe  table,  the  strongest  correlations  were  observed  between  the  performance 
scores,  and  Hie  biographical  items  o?  age,  rank,  and  years  of  military  service. 

-The  assumption  that  predictor  and  performance  data  is  intervally  scaled 
permitted  analysis  of  correlations  computed  using  regression  techniques.  The 
strength  and  nature  of  .relationships  between  predictor  items  as  measured  by  the 
correlation  coefficients  between  these  items  are  shown  in  Table  12.  The  strongest 
correlations  were  observed  between  the  biographical  items  of  age,  rank,  and 
years  of  milita.y  service. 

The  correlation  coefficients  derived  from  simple  linear  regression  between 
each  of  the  four  performance  scores  and  each  item  of  predictor  data  are  presented 
in  Table  13.  Analysis  of  the  adjusted  overall  weighted  score  produced  no  sig¬ 
nificant  correlation  with  any  of  the  predictor  items, 

A  multiple  correlation  coefficient  was  also  calculated  far  each  of  ihe 
four  performance  scores.  To  accomplish  this,  a  multiple  regression  was  performed 
between  the  items  of  predictor  data  and  each  performance  score.  In  using  this 
technique  the  inclusion  of  an  additional  predictor  item  will  increase  the  multiple 
correlation  coefficient,  however,  if  the  individual  correlation  of  the  included 
item  is  not  strong, 'the  inclusion  of  thc-t  item  will  reduce  the  significance  of  the 

} 

multiple  correlation  coefficient.  Therefore,  only  those  items  of  predictor  data 
were  included  in  the  regression  computation  which  would  not  reduce  the  signifi¬ 
cance  of  the  resulting  multiple  correlation  coefficient  below  a  level  of  .10.  The 
■  multiple  correlation  coefficients  thus  computed  are  presented  in  Table  14.  It  was 
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Teble  II 


Spsa rmon  Rank  Correlation  Cocfficieris  beiween 
Predictors  and  Performance  Scores 


Predictor. 

Performance  Scores 

individually 

Overall 

Weighted 

Weighted 

Age 

.379** 

.325** 

Rank 

.448** 

ocp** 

Years  of 

Military  Service 

.365** 

.273** 

Years  in 

Procurement  Field 

.218* 

.203* 

Technical.  Training 

-.167 

-.153 

Individual 

Prominence 

-.057 

.075 

Tolerance  of 

.019 

.020 

Disagreement 

*$ignificant  af  .10  level 
**Significant  af-  .05  level 


Note:  Sample  size  is  42. 
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t 
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Icter-psredfcSsr  CaisJsfiM  Coefficients  Derived 
from  Sisyfa  linear  Rscressicn 


Age  Ranrs. 


Years  c*f  Yecs  in 
Military  Prccuremerst 
Service.  Peid 


Technical  Individual  Tolerance 
Training  Prominence  of 

Disagreement 


Age  - 

.669  .911 

.463 

.070 

.125 

.200 

Sark 

.473 

.454 

.107 

-.127 

.019 

Y»crs  of 

Military 

Service 

— 

.384 

-.084 

-.211 

.181 

Yeats  ir. 
Procurement 

Field 

— 

.375 

-.007 

.071 

Technical 

Training 

- 

.060 

.105 

Individual 

Prominence 

- 

.054 

Tolerance  of 
Disagreement 

- 

Note:  Correlation  Coefficients  larger  than  .217  are  significant 
at  the  .10  level. 

Correlation  Coefficients  larger  than  .260  are  significant 
at  the  .05  level. 

Sample  size  is  42. 
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Tdhle  13 

CxxTzk&tsa  Coefficients  bSseas  tteaidos  end 
iffeKoracscs  Scares  Derived  fossa 
Sspk  Linear  Session 


Preekhs.  fedctnsance  Scores 


hn £v>dun!'y 
Weighted 

Overall 

Weighted 

Adjusted 

Individually 

Weighted 

Adjusted 

Overall 

Weighted 

Age 

1311** 

.270** 

.273* 

.057 

Rank 

.428** 

.354** 

.374** 

.159 

Years  of 
Military 
Service 

.264** 

.217* 

.224 

.052 

Years  in 

Procurement 

Field 

.243* 

.219* 

.367** 

.235 

Technical 
Training 
(total  courses) 

-.258** 

-<308** 

.179 

.128 

Individual 

Prominence 

-.096 

-.008 

-.081 

.067 

Tolerance  of 
Disagreement 

-.038 

-.021 

'  .183 

.094 

*Significant  at  .10  level 
**Significant  at  .05  level 

Note:  Sample  si^e  for  Individually  and  Overall  Weighted  scores  is  42 
and  29  for  the  Adjusted  scores. 
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*Significant  at  the  .10  level 
^^Significant  at  the  .05  level 


found  irest  no  ccsabiscfion  of  pcedickar  waradblss  resalSed  in  a  cwlSpSe  csstsIcSoq 
cs@nder.t«iSi  o  significance  of  .10  off  beSfer  with  rasped  to  fhe  cwer- 

cll  weighted  score.  If  con  be  noted  frcca  Tables  13  and  14  that  the  predictor 
I  fen,  “Years  in  the  frocureroesst  Field,"  is  the  only  ptdidcr  variable  which  is 
used  in  oil  four  multiple  recession  ccppufgfioos,  clihcucn  if  is  not  tecessnily 
the  roost  strongly  correlated  variable  in  each  regression. 


"CHapf£r4 
COLLUSIONS 
Hypothesis  Teeing 

The  pressory  ocjscJivs  or  mis  thesis  wcs  to  d^ensios  wnalier  teldion- 
snips  exisr  between  job  penwccnce  cr  Aeronautical  Sysiess  Division  officers 
end  selected  dissensions  erf  their  frails  end  backgrounds.  To  ccccrrplish  this  ob¬ 
jective,  the  follcwing.hypothesls  y/aslesld>  “The  qualify  of  on  individual's  job 
performance  can  be  related  to  his  biographical  data  or  his  psychological  frails 
or  both."  The  examination  of  this  hypothesis  consisted  of  answering  three  re¬ 
search  questions. 

Research  Question  Number  One 

The  first  research  question  was,  "Can  a  measurement  device  be  de¬ 
veloped  which  will  accurately  measure  a  procurement  officer's  performance, 
based  on  a  supervisor's  rating?”  The  24  item  "Job  Performance  Rating  Scale" 
(Appendix  A)  was  developed  and  was  completed  for  42  procurement  officers.  The 
scoring  of  these  questionnaires  resulted  in  the  "Individually  Weighted  Score"  for 
a  subject  which  was  based  only  on  the  opinion  of  that  subject's  supervisor,  and 
the  "Overall  Weighted  Score"  for  a  subject  which  was  based  on  his  supervisor's 
opinion,  but  modified  by  the  opinions  ot:  all  the  supervisors  who  participated  in 
.  the  study.  Each  of  these  performance  scores  very  accurately  reflected  the  rank 
ordering  of  subjects  provided  by  supervisors  on  the  "Overall  Performance"  in¬ 
strument.  However,  the  presence  of  rater  bias  in  both  of  these  scores  indicated 
that  comparisons  of  rhe  performance  of  subjects  who  were  rated  by  different 
supervisors  could  not  be  considered  accurate.  The  adjustment  procedure,  which 
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«os  used  to  elisir vse  tbe  rater  bies  cr  tbs  scores,  did  not  effect  ire  park  ordering 
eocn  supervisor  assigned  to  tbs  scbjscs  Shot  Se  rated.  Ir  wcs  therefore 
concluded  Shot  tbs  odjistsd  rnohnanliy  weighted  scores  computed  freer  tbs 
measurement  device  accurately  ssesum  tbs  relstr/e  fsdomascs  of  trie  subjects 
and  are  nee  of  rcier  bias. 

It  was  also  concluded  that  ths-cpclication  of  both  the  overall  v/eienting 
and  the  adjustment  procedures,  which  resulted  in  the  adjusted  overall  weighted 
score,  so  reduced  the  influence  of  an  individual's  supervisor  on  his  rating,  and 
so  compressed  the  range  of  these  ratings  and  reduced  their  dispersion,  that  the 
resufUsg  performance  measure  could  not  discriminate  between  the  perfomance 
of  the  subjects. 

Research  Question  Number  Two 

The  second  research  question  was,  3Is  a  procurement  officer’s  perfor¬ 
mance  as  defined  by  the  measurement  device,  statistically  related  to  the  officer's 
biographical  data,  that  being  age,  rank,  length  of  service,  procurement  ex¬ 
perience,  educational  experience,  and  source  of  commission,  or  to  his  psycho¬ 
logical  traits  of  individual  prominence  and  tolerance  of  disagreement?"  Pro¬ 
curement  officers  were  categorized  according  to  their  educational  level,  under¬ 
graduate  major  field  of  study,  current  enrollment  in  an  academic  course,  and 
-  source  of  commission.  It  can  be  concluded  from  the  results  that  procurement 
officers  who  possess  advanced  degrees  tend  to  be  superior  in  performance  to 
those  officers  who  possess  a  baccalaureate  degree.  With  respect  to  undergraduate 
fields  of  study,  the  findings  indicate  that  there  is  no  significant  difference  be¬ 
tween  the  performance  of  procurement  officers  with  business  oriented  degrees 


and  ins  pe sroraarZs  of  ihc&s  czfscers  vnih  decrees  not  related  to  the  business 
field.  The  findings  fail  to  mdicofe  cany  relationship  ScSween  performance  cndr 

GKrent^nroffraenf  in  cn  cccdesnic  course.  In  addition,  the  findings  did  not  , 

•  » 

indicate  that  sny  particular  source  of  commission  was  related  to  superior  perfor- 

-  *  -  I 

tnance.  i  : 

The  remaining  i tarns  of  biographical  data,  otje,  rank,  years  of  military 
"  ■  -  5 
service,  years  in  the  procurement  field  and  technical  training,  and  the  psycho- 

5  •  !  ! 

logical  traits,  individual  prominence  and  tolerance  of  disagreement,  were  treated 

>  ? 

both  as  ordinary  scaled  data  and  as  infervally  scaled  data,  as  were  the  individ¬ 
ually  weighted  and  overall  weighted  performance  scores.  .The  ordinal  treatment, 
which  used  the  Spearman  rank  correlation  technique,  indicated  that  age,  rank, 
years  of  military  service  and  years  in  the  procurement  field  were  significantly  re¬ 
lated  to  performance,  while  technical  training,  individual  prominence  and 

1  * 

tolerance  of  disagreement  were  not;  In  addition,  the  correlations  between  the 

individually  weighted  score  and  a  predictor  and  the  overall  weighted, score  and 

that  predictor  were  almost  identical.  The  interval -analysis  of  these  predictors  ’ 

i  .  i 

and  performance  scores,  which  resulted  in  correlation  coefficients  derived  from 

i  I 

regression  techniques,  produced  results  which  closely  paralleled  thqse  produced 
by  the  ordinal  treatment.  This  similarity  can  be  seen  in  Table  *5  whiclvsummarizps 

these  results.  The  similarity  of  these  results  indicates  the  assumption  of  intervally 

! 

scaled  data  is  justified.  5  . 

* 

The  problem  with  results  thus  achieved  is  that  the  correlation  coefficient? 
were  derived  using  individually  weighted  and  overall  weighted  performance  | 

T  * 

scores.  It  has  been  demonstrated  that  there  is  rater  bias  present  in  these  scores. 


* 


Predictor 


Years  of 
Military  Service 

Years  in  , 

I  * 

-Procurement  Field 

i 

Technical  Training 

Individual 

Prominence 


Tolerance  of 
Disagreement 


t 
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However,  since  the  assumption  of  interval  data  is  justified,  analysis, based  on  Hie 
adjusted  individually  weighted  performance  scores  can  be  made. 

The  results  of  this  analysis  indicate'  that  on  an  individual  basis  the  pre¬ 
dictors  of  age,  rank,  yearsln  the  procurement  field,  and  technical  training  are 
significantly  correlated  to  performance.  The  correlations  found  between  the  pre- 
dictors  of  years  of  military'  service,  individual  prominence,  and  tolerance  of 
disagreement  and  performance  could  not  be  considered  statistically  significant 
on  an  individual  basis. 

Research  Question  Number  Three 

The  third  research  question  was,  "Is  a  procurement  officer's  performance, 
as.  defined  by  the  measurement  device,  statistically  related  to  combinations  of 
his  biographical  data  and  psychological  traits?"  The  multiple  regression  analysis 
resulted  in  a  multiple  correlation  coefficient  of  .469  between  the  predictors  of 
rank,  years  in  the  procurement  field,  and  tolerance  of  disagreement  and  the  ad¬ 
justed  individually  weighted  performance  score.  This  correlation  is  significant 
at  the  .10  level.  This  result  indicated  that  combinations  of  predi ctors,  including 
both  biographical  data  and  psychological  traits,  are  related  to  procurement 
performance. 


Chapter  5 

IMPLICATIONS  AND  RECOMMENDATIONS 
FOR  FURTHER  STUDY 
Performance  and  Predictor  Measurement 
.  The  presence  of  rater  bias  in  both  the  "Individually  Weighted"  and 
"Overall  Weighted"  performance  scores  can  most  probably  be  attributed  to  the  fact 
that  only  one  rating  was  used  to  establish  a  subject's  performance  score.  As  a 
result  of  this  bias,  the  use  of  a  somewhat  artificial  adjustment  procedure  was 
deemed  necessary.  A  more  precise  and  less  artificial  technique  would  be  to  con¬ 
sider  several  ratings  completed  by  several  different  supervisors  for  each  individual. 
In  this  way,  the  effects  of  rater  bias  would  be  minimized  in  the  ratings  them¬ 
selves.  To  utilize  ratings  contributed  by  several  different  supervisors  for  each 
subject,  a  study  of  procurement  officers  would  necessarily  encompass  several 
years.  Unfortunately,  a  study  of  this  duration  was  beyond  the  scope  of  this 
thesis. 

Although  all  the  subjects  surveyed  in  this  study  were  procurement 
officers  involved  in  weapon  systems  acquisition,  there  was  still  a  certain  amount 
of  variation  in  the  duties  and  requirements  of  each  officer's  job.  Some  were 
contract  negotiators,  others  were  primarily  price  analysts,  others  were  contract 
administrators,  and  so  forth.  It  is  possible  that  the  biographical  attributes  and 
the  psychological  traits  which  were  investigated  in  this  study  would  correlate 
differently  with  the  performance  of  contract  negotiators,  price  analysts,  and  so 
forth.  If  this  were  the  case  the  inclusion  of  these  procurement  officers  with 
differing  jobs  may  have  obscured  the  underlying  relationships. 
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If  is  therefore  recommended  thaifurtherstudies  In  this  area-includeper- 
fcnncnce  ratings  confribyted  fey  several  supervisors  over  a  period  of  years.  Since 
refinossjeh  os  these  are  gathered  in  the  form  of  Officer  . Effectiveness  Ratings 
(OER’s),  farther  research  should  include  an  investigation  of  the  possible  utility  of 
these  ratings,  if  is  also  recommended  that  further  investigation  in  this  area  iden¬ 
tify  and  analyze  specific  funfions  of  the  procurement  field  such  as  contract  ne¬ 
gotiation,  price  analysis,  and  contract  administration.  It  is  also  recommended 
that  additional  studies  of  this  nature  include  procurement  officers  assigned  to 
different  organizations  throughout  the  Air  Force.  * 

The  analysis  of  predictor  data  indicates  that  several  items  of  biographical- 
data  ere  highly  intercorrelated.  Since  this  is  the  case,  if  may  be  necessary  to 
examine  a  large  number  of  different  biographical  items  in  addition  to  those  ex¬ 
amined  in  this  study  in  order  to  obtain  predictor  items  which  are  relatively  in¬ 
dependent  of  one  another. 

It  is  also  apparent  that  this  thesis  did  not  exhaust  the  number  of  psycho¬ 
logical  traits  which  may  be  related  (a  procurement  performance.  It  is  hoped  that 
further  study  would  expand  the  area  of  investigation  to  include  such  other  traits 
as  aggressiveness,  decisiveness,  intelligence,  and  self-assurance.  Another 
important  dimension  of  personality  which  should  be  addressed  is  that  of  motiva¬ 
tion. 

Predictive  Relationships 

Tlie  study  indicates  that  relationships  between  an  officer's  performance 
and  certain  items  of  his  biographical  data  such  os  type  of  degree,  undergraduate 

major  field  of  study  jnd  so  foith,  which  are  categorizations,  can  be  statistically 
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significant.  However,  when  the  number  of  categories  of  such  an  item  is  large, 
for  example,  undergraduate  major  field  of  study,  a  statistical  analysis  which  con¬ 
siders  all  categories  can  only  be  performed  if  the  number  of  subjects  involved  in 
the.studyr,is  quite  large.  Jn  general,  the  significance  of  the  results  of  all  the 
statistical  tests  and  techniques  used  in  this  study  would  have  been,  enhanced  by 
increasing  the  number-'of  subjects  participating  in  the  study. 

The  resuitsof  this  study  indicated  that  the  four  biographical  items  of 

age,  .rank,  years  of  military  service,  and  years  in  the  procurement  field  were. 

/ 

similarly  correlated  to  performance.  It  was  also  found  that  these  four  predictor 
items  are:strongly  intercorrelated.  Although  it  is  possible  that  each  of  these 
variables  could  be  independently  correlated  to  performance,  it  appears  far  more 
likely  that  one  of  these  variables  was  independently  linked  to  performance,  and 
that  the  other  three  variables  correlated  to  performance  merely  due  to  inter¬ 
correlation  with  that  variable.  In  order  to  determine  if  this  effect  occured,  it 
would  be  necessary  to  analyze  the  effect  of  one  predictor  variable  on  performance 
while  holding  the  other  variables  constant.  For  example,  to  fully  investigate 
the  relationships  between  age,  rank,  and  performance  a  series  of  regressions 
should  be  performed  between  performance  and  rank  for  subjects  who  were  the 
same  age,  and  conversly,  between  performance  and  age  among  subjects  who  held 
the  same  rank.  An  analysis  of  this  nature  would  demand  a  very  large  number  of 
subjects,  since  it  would  require  a  large  number  of  subjects  who  were  the  same  age, 
and  a  large  number  of  subjects  who  held  the  same  rank. 

It  should  be  pointed  out  that  one  of  the  predictors  that  correlated  most 
strongly  with  performance  was  procurement  experience,  that  is,  "years  in  the 
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procurement  field,”  and  that  this  ’’predictor”  obviously  cannot  be  used  in  ihe 
selection  of  new  procurement  officers.  Since  the  subjects  of  this  study  did  possess 
varying  amounts  of  procurement  experience,  however,  it  was  necessary  to  recog¬ 
nize  the  variable  and  measure  it  in  an  attempt  to  isolate  its  importance.  Never¬ 
theless,^  is  also  interesting  to  note  that  the  relationship  between  procurement 
experience  and  procurement  performance  was  no  where  near  as  strong  as  might 
have  been- anticipated.  This  strongly  indicates  that  other  biographical  or  psycho¬ 
logical  variables  may  have  a  major  impact  on  procurement  performance. 

Another  implication  can  be  drawn  from  the  finding  that  there  was  no 
significant  correlation  between  technical  training  and  performance,  while  the 
performance  of  subjects  who  held  advanced  degrees  was  superior  to  the  performance 
of  those  subjects  who  held  baccalaureate  degrees.  Thus  it  appears  that  a  pro¬ 
curement  officer  derives  more  benefit  from  advanced  academic  education  than 
from  technical  training. 

Further  implications  can  also  be  drawn  from  the  intercorrelation  of  pre¬ 
dictor  variables.  In  a  case  such  as  that  observed  between  age  and  rank  in  this 
study,  where  two  predictor  variables  were  highly  intercorrelated  and  were 
nearly  equally  correlated  to  performance,  it  is  also  possible  that  these  relation¬ 
ships  could  be  explained  by  the  presence  of  an  underlying  variable.  For  example, 
both  age  and  rank  might  be  expected  to  correlate  highly  to  an  index  of  maturity 
of  the  subjects.  It  might  also  be  expected  that  rank  would  correlate  more  strongly 
to  maturity  than  would  age.  If  maturity  were  then  in  turn  highly  correlated  to 
procurement  performance,  then  correlations  between  age,  rank,  and  performance 
as  were  observed  in  this  study  would  be  expected.  Thus  it  is  possible  that 
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selected  combinations  of  biographical  items  could  be  considered  to  be  measure¬ 
ments  of  psychological  traits. 

The  basic  purpose  of  this  thesis  was  to  provide  a  means  to  improve  the 
quality  of  Department  of  Defense  procurement  actir-'s  by  developing  a  technique 
for  identifying  and  selecting  those  individuals  for  procurement  positions  whose 
biographies  and  traits  indicate  that  they  would  excel  in  the  procurement  field. 
Although  the  results  of  this  study  did  not  produce  a  highly  refined  and  reliable 
technique  for  identifying  potentially  superior  procurement  personnel,  the  results 
of  this  study  did  indicate  that  further  research  in  this  area  is  warranted  and  that 
additional  research  could  be  expected  to  produce  such  a  technique. 
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JOB  PERFORMANCE  HATING  SCALE 


JO&  PERFORMANCE  RATING  SCAIE 
INSTRUCTIONS 


1.  Please  provide  the  following  informoticn  on  the  officer  you  are  rating: 
'  A.  fils  rank _ 


8.  The  initial  of  his  lost  ncir.e _ _ 

C.  The  last  four  digits  of  his  social  security  number. 


2.  Please  readthe  itemsbelcw  and  evaluate  the  demonstrated  performance  of  the  officer  iden¬ 
tified  above.  The  information  in  paragraph  ="1  above?  wit!  only  be  *jsed  to  pair  inis  rating  with 
the  vest  taken  bv  the  rated  officer.  Since  your  responses  will  in  no  way  be  used  in  any  personnel 
action/  nor  be  associated  with  either  your  identity  or  the  identity  of  the  officer  you  are  rating, 
rate  his  performance  very  carefully  and  frankly.  For  each  item,  rate  his  performance  only  on  that 
factor.  Please  do  not  discuss  this  questionnaire  with,  or  reveal  your  ratings  ?©,  the  officer  being 
rated. 

Using  the  rating-scale  provided,  piace  next  to  each  item  the  numerical  value  of  the  de¬ 
scription  that  best  describes  the  officer’s  (ratee's)  performance.  Keep  in  mind  a  rating  of  zero  (0) 
or  one  (1)  indicates  the  ratee  is  doing  a  fair  job  with  respect  to  the  attribute  described;  and  that 
an  eight  (8)  or  nine  (9)  indicates  the  latee  is  doing  an  outstanding  job  with  respect  to  the  attribute 
described.  A  rating  of  two  (2),  three  (3)  or  four  (4)  indicates  the  ratee  is  doing  a  good  job;  and  a 
five  (5j,  six  (6)  or  seven  (7)  indicates  superior  performance  with  respect  to  the  attribute.  Be  sure 
to  assign  q  rating  for  each  item  listed. 


Fair 
1  2 


Good 


Superior 
5  6 


Outstanding 
7  8  9 


0  12  3  4 

1 .  The  officer  conducts  his  business  on  a  high  moral  plane.  In  this  respect  the  officer  is: 

2.  The  officer  emphasizes  the  use  of  two  or  mere  competitive  bids  for  each  contract ,  In 
this  respect  the  officer  is: 

3.  The  officer  recognizes  the  relative  importance  of  problems  and  puts  them  in  proper  per¬ 
spective.  In  this  respect  the  officer  is: 

4.  The  officer  is  well  acquainted  with  Air  Force  methods  of  inspection  and  has  good  con¬ 
tact  with  government  inspectors,  in  this  respect  the  officer  is: 


5.  The  officer  contracts  for  materials  which  constantly  meet  the  minimum  quality  specified. 
In  this  respect  the  officer  is: 


6.  The  officer  easily  adjusts  to  frequent  change.  He  is  flexible  in  his  thought  process.  In 
this  respect  the  officer  is: 


7.  The  officer's  actual  costs  are  generally  close  to  estimated  costs.  In  this  respect  the  officer 
is: 


8,  The  officer  negotiates  firm  delivery  dates.  In  this  respect  the  officer  is: 


Fair  Good  Superior  Outstanding 

0  123456789 

9.  The  officer  protects  the  Air  Force  from  losses  resuiting  from  psor  qualify  (  ie.  return 
expenses,  excess  scrap).  In  this  respect  the  officer  is: 

TO.  The-officerprovidescssistance  in  developing  specifications,  fn  this  respect  the  officer  is: 

11.  The  officer  is  very  adeptand  successful  in  price  negotiations.  !n  this  respect  the  officer  is: 

12.  The  officer  is  involved  in  activities  to  improve  his  procurement  skills,  fn  this  respect 
the  officer  is: 

13.  The  officer  is  aware  of  package  costs  and  assists  in  establishing  packaging  specifica¬ 
tions.  In  this  respect  the  officer  is: 

14.  The  officer  keeps  his  supervisor  informed  on  all  important  matters  and  prepares  data  or 
furnishes  information  when  asked.  In  this  respect  the  officer  k:. 

15.  The  officer  uses  value  analysis  or  other  evaluation  methods  to  determine  the  target 
cost.  In  this  respect  the  officer  is: 

16.  The  officer  is  awaie  of  the  problems  of  production  and  scheduling.  He  considers  them 
when  establishing  delivery  dates.  In  this  respect  the  officer  is: 

17.  The  officer  spends  adequate  time  with  the  engineering  office  concerning  quality  re¬ 
quirements.  In  this  respect  the  officer  is: 

18.  The  officer  formulates  new  ideas  or  methods  for  accomplishing  objectives.  In  this 
respect  the  officer  is: 

19.  The  officer  is  aware  of  documentation  costs  and  assists  in  establishing  the  amount  of 
documentation  required.  In  this  respect  the  officer  is: 

20.  The  officer  is  abreast  of  potential  and  immediate  problems  his  contractors  have  in  order 
to  avoid  late  delivery.  In  this  respect  the  officer  is: 

21 .  The  officer  is  able  to  persuade  a  department  to  accept  substitutes  that  will  reduce  costs 
for  the  government.  In  this  respect  the  officer  is: 

22.  The  officer  follows  directions  and  takes  appropriate  action  with  the  minimum  amount  of  su 
pervision.  He  does  this  promptly  and  efficiently,  and  the  results  are  satisfactory.  In  this 
respect  the  officer  is: 

23.  The  officer  expresses  himself  in  meetings  and  briefings  so  that  others  understand  him 
clearly.  In  this  respect  the  officer  is: 

24.  The  officer  realizes  the  problems  of  the  people  with  whom  he  works.  He  handles  them 
in  such  a  manner  that  each  person  he  deals  with  is  left  with  a  feeling  that  his  problem  has 
been  adequately  resolved.  In  this  respect  the  officer  ir»: 
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DIMENSIONS  OF  PROCUREMENT 

-*  There  ere  several  aspects  of  procurement  that  on  individual  may  emphasize  in 

A  m  the  performance  of  his  duties.  These  aspects  can  be-summarized  in  the  following  five 
dimensions: 

1.  Price  -  finds  end  negotiates  the  lowest  cost 

2.  Quality  -  procures  goods  that  meet  the  highest  standards. 

3.  Suitability  -  procuresgoods  that  are-best  in  terms  of-  their-  intendeduse. 

4.  Delivery  -  schedules  cause  no  problems  with  production  or  planning. 

5.  Management  -  aids  the  supervisor  in  the  efficient  operation  of  the  organization. 

The  relative  importance  of  each  of  these  dimensions  may  be  expressed  by 
assigning  a  percentage  to  each  dimension.  For  example,  a  hypothetical  procurement  officer 
might  rate  the  five  dimensions  as  follows: 

Price  25% 

Quality  30% 

Suitability  15% 

Delivery  10% 

Management  20% 

Total  100% 

Please  indicate  the  relative  importance  of  these  dimensions  as  they  pertain  to 
the  mission  of  your  organization  by  assigning  a  percentage  to  each  dimension. 

Price  % 

Quality  _ % 

Suitability  _ % 

*  Delivery  _ % 

Management  _ % 

Total  100  % 

.-/JU-  ---  .  -----  - 


i 
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OVERALL  PERFORMANCE  RATING  SCALE 
INSTRUCTIONS 

Please  indicafe  on  the  scale  below  your  overall  impression  of  job  performance 
of  The  procurement  officers  that  you  v/ill  rate.  Indicate  your  impression  by  placing  the 
officer's  last  name  initial  and  the  last  four  digits  of  his  social  security  number  to  the  right 
of  the  scale.  It  is  important  that  no  two  officers  receive  the  same  rating,  but  it  is  possible 
that  two* or  mere  may  be  very  close' on  the- scale. 


the  most  outstanding  officer 
I  have  known 


-r  100 


+  90 


outstanding 


superior 


average  or  below  average  4- 


80 


70 


60 


J-  50 


I 
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I  :  .  j 

e-  .  -  !  • 

:  '  I 

,  PROCUREMENT  OFFICER  SURVEY 

i 

9  _  • 

This  questionnaire  is.part  of  a  research  effort  aimed  at-developing  a  composite  profile 
of  an  outstanding  procurement  officer.  Your  cooperation  in  this  effort  is  greatly  appreciated. 

:  #  f 

*  Please  complete  the  following  items  of  biographical  .data: 


1 .  A§6:  __  .  1 

*  2.  Rank:  _ * 

‘  1  i 

3.  Years  of  Military  Service: 

*  -  ,  *  :  «  ■ 

4.  Years,  of  experience  in  tne  Procurement  .career  area: 

:  i 

-  i 

5.  Types  of  Procurement  assignments:  '  * 

1  -  i  .  ‘ 

A.  Base  Level  1  ■  - 

5  <  * 

} 

Yes,  for  a  total  of  years. 

■  .  No  :  : 

- ■  •  ' 

i  * 

B.  Depot  Level .  .  •  ' 

:  Yes,  for  a  total  of  yeqrs . 

_ _No  ! 

i  . 

6.  Educational  Experience:  !  ,  .  i 


7. 


*  I 


Place  a  check  («/)  next  to  type  of  degree  (  or  degrees)  which  you  hold: 

.  *  I  - 

B-.S.  !-B.A.  ‘  •  M.Si. 

j _ M.A.  .  !  _ M.B.A.  _ P(H  D. 

_ Nones  Other  ■  _ 

•  (please  specify) 

Undergraduate  Major:  . 

^  >  J 

Place  a  (check  (/)  next  to  your  undergraduate  majo.r. 

.  i  * 


Business 

_ Economics  * 

Engineering 
Other  i  _ 

(please  specify) 


Accounting  j 
Social  Science 
.  Humahities 

i 


Marketing 
Physical  Science 
None 

•  i  i 


i 
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8.  Are  you  currently  enrolled  in  an  academic  course? 

_ A.  Yes,  undergraduate  level. 

B.  Yes,  graduate  level. 

C.  No. 


9.  Professional/Technical  Training: 

'  Place  a  check  •(»/)  next  to  each  course  which  you  have  completed: 

A.  Defense- Procurement  Management  (i  5* weeks-)* 

_ B.  Contract  Administration  (  4  weeks), 

. _ _C.  Industrial  Property  Administration  (  3  weeks  ) 

D.  Cost  and  Price  Analysis  and  Negotiation  Technique  (3  weeks) 

_ E.  Two-Step  Formal  Advertising/Multi  Year  Procurement  (  2  days  ) 

_ F.  Defense  Advanced  Procurement  Management  (  3  weeks ) 

_ G.  Contract  Law  (  2  weeks ) 

_ H.  Art  and  Technique  of  Negotiating  Contract  Modifications  (  1  week  ) 


10.  Source  of  Commission: 

A.  ROTC 

_ B.  OTS/OCS 

_ C .  Service  Acaa'emy 

_ D.  Other 

(please  specify) 

Please  read  the  items  below  and  indicate  how  well  each  statement  describes  you  by  placing 
a  number  to  the  right  of  the  statement  in  the  space  provided.  If  the  statement  describes  you 
very  accurately,  place  a  one  (1)  to  the  right  of  the  statement.  If  the  statement  describes 
you  very  inaccurately,  place  a  five  (5)  to  the  right  of  the  statement.  A  two  (2)  means  the 
statement  describes  you  fairly  accurately,  a  three  (3)  means  the  statement  is  neither  accurate 
nor  inaccurate,  and  a  four  (4)  mean  the  statement  is  fairly  inaccurate. 

Very  Fairly  Neither  Accurate  Fairly  Very 

Accurate  Accurate  Nor  Inaccurate  Inaccurate  Inaccurate 


1  2  3  4  5 

11.  In  meetings  of  groups  to  which  I  belong  I  often  find  myself  frying  to  get  things 
organized. 

12.  1  occasionally  tell  strangers  about  things  I  am  interested  in  without  direct  questions 

»  from  them . 


13,  I  like  it  when  1  know  so  well  what  the  group  has  to  do  that  1  naturally  become  the 
one  in  command. 


2 


Very  Fairly  Neither  Fairly  Very 

Accurate  Accurate  Nor  Inaccurate  Inaccurate  Inaccurate 

1  2  3  4  5 

14.  l.think  I  am  better  described  as  polite  and  quiet  than  as  lively  and  active. 


t  .15.  When  a  speaker  asks  anyone  in  the  audience  to  volunteer  an  idea  to  start  discussion,  I 

seldom  speak  out.. 

16.  in  playing  games  wheivyoung>,  l  offer  tookthe  lead  and  decided  what  the  group  should 

play.  __ 

17.  More  than  the- average' person,  l  try  to  attain  recognition  in  groups  of  which  I  am  a 
member. 


18.  I  almost  never  tell  strangers  about  anything  I  am  interested  in  unless  they  ask  me  about, 
it. 

19.  l  am  pleasedwhen  my  boss  or  superior  leaves  me  in  charge  of  the  group. 

20.  I  have  sometimes  been. described  as  a  rather  headstrong  person,  following  my  own  ideas 
regardless  of  the  opinions  of  others. 


21 .  My  friends  often  refer  to  me  as  a  conformist. 


22,  If  I  disagree  with  the  teacher  or  lecturer  in  a  class,  I  generally  openly  express  my 
difference  of  opinion. 


23.  ^usually  take  the  initiative  in  opposing  the  "bossy"  way  some  chairmen  conduct 
meetings. 


24.  I  make  my  own  decisions,  uninfluenced  by  the  opinions  of  others. 

25.  I  enjoy  taking  the  lead  in  group  discussions. 


26.  At  accidents  or  fires,  when  there  are  several  persons  present,  I  as  a  rule  take  an 
active  part  in  assisting. 


27.  In  a  mixed  social  group,  where  many  people  are  strangers  to  each  other,  I  frequently 
constitute  myself  as  host  and  begin  introductions  and  conversations. 


28.  If  I  disagree  with  someone,  l  rarely  let  them  know  that  I  disagree. 


29.  At  dull  parties,  I  frequently  take  the  initiative  in  trying  to  inject  some  life. 

30.  When  riding  on  a  bus  or  train,  I  seldom  take  the.  initiative  in  starting  a  conversation 
with  a  seatmate  with  whom  I  am  unacquainted. 
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Accurate  Accurate  Nor  Inaccurate  inaccurate  Inaccurate 

1  2  -3  4  5 

31.  As  a  rule  I  am  relaxed  in  the  presence  of  my  superiors. 

*  * 

32.  in  group  situations  1  am  quick  to  take  the  iead  when  an  opportunity  presents  itself, 

33.  As  a  role,  I  am  content  to  sit  back  and  let  others  be  the  leaders. 

34.  !  probably  would  be  considered- somewhat  "aufhorifaritan"  in  my  behavior  to  words 
others. 


Please  read  the  following  statements  and  indicate  your  agreement  or  disagreement  with 
them  by  placing  a  number,  from  one  (1)  to  five  ($)  after  each  item,  according  to  the  following 
scale: 


Strongly 

Agree 

Agree’ 

Neutral 

Disagree 

Strongly 

Disagree 

1 

2 

3 

4 

5 

35.  It  is  very  difficult  to  be  friends  with  a  person  who  disagrees  with  one's  own  beliefs. 

36.  1  sometimes  argue  for  things  which  1  do  not  believe,  just  to  promote  a  lively 
discussion. 

37.  People  in  general  spend  too  much  time  arguing  about  things  which  do  not  make  too 
much  difference  anyway. 

38.  In  the  interests  of  harmony,  if  is  often  necessary  to  pretend  to  agree  with  others, 
even  when  you  do  not. 

39.  People  who  have  the  same  attitudes  and  opinions  as  myself  fend  fc  be  rather  boring 
at  times. 

40.  Class  discussions,  where  conflicting  points  cf  view  are  expressed,  are  usually  more 
beneficial  to  learning  than  are  lectures. 

41.  So  called  friendly  discussion  of  controversial  issues  too  often  result  in  hard  feelings. 

42.  It  is  quite  interesting  and  beneficial  to  discuss  politics  and  religion  with  people  who 
have  quite  different  views  from  one's  own. 
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Performance  Scores  by  Subject 


Subject 

Performance  Scores 

Number 

Individually 

Weighted 

Overall 

Weighted 

Adjusted 

Individually 

Weighted 

Adjusted 

Overall 

Weighted 

1 

84 

81 

74 

73 

2 

85 

72 

75 

71 

3 

70 

67 

60 

59 

4 

80 

79 

71 

72 

5 

71 

72 

62 

65 

6 

68 

71 

60 

63 

7 

71 

71 

62 

64 

8 

72 

73 

63 

66 

9 

85 

82 

76 

75 

10 

76 

72 

68 

64 

11 

76 

73 

68 

64 

12 

87 

79 

78 

72 

13 

84 

76 

75 

68 

•14 

86 

79 

77 

71 

15 

84 

76 

75 

69 

16 

84 

74 

75 

67 

17 

74 

68 

- 

•• 

18 

72 

67 

- 

- 

19 

63 

61 

- 

- 

20 

70 

69 

- 

- 

21 

67 

64 

- 

- 

22 

71 

64 

- 

- 

23 

75 

72 

- 

- 

24 

52 

51 

- 

_ 

25 

52 

51 

- 

- 

26 

78 

76 

69 

68 

27 

79 

77 

71 

68 

28 

80 

77 

71 

69 

29 

71 

68 

63 

60 

30 

85 

82 

76 

73 

31 

64 

63 

69 

67 

32 

66 

64 

- 

~ 

33 

43 

41 

- 

- 

34 

82 

77 

mm 

- 

35 

57 

55 

mm 

- 

36 

66 

68 

83 

78 

37 

64 

71 

81 

81 

62 


Performance  Scores  by  Subject 


Subject 

Number 

Performance  Scores 

Individually 

Weighted 

Overall 

Weighted 

Adjusted 

Individually 

Weighted 

Adjusted 

Overall 

Weighted 

38 

64 

70 

81 

81 

39 

55 

52 

71 

63 

40 

50 

48 

66 

£9 

41 

37 

46 

54 

56 

42 

37 

45 

53 

56 
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APPENDIX  E 

PREDICTOR  RESPONSES  BY  SUBJECT 


predictor  Responses  by  Subject 


Subject  _  Predictor 

Number  .  Age  Rank  Years  of  Years  in  Technical  Individual  Tolerance 

(see  Military  Procurement  Training  Prominence  of 

note)  Ser/ice  Field-.  (total  Disagreement 

courses) 


1 

33 

04 

11 

1 

0 

68 

19 

2 

23 

01 

5 

1 

0 

53 

24 

3 

27 

03 

4 

4 

1 

51 

20 

4 

28 

03 

5 

3 

2 

50 

19 

5 

28 

03 

5  - 

4 

0 

65 

17 

6 

24 

02 

2 

2 

0 

65 

14 

7 

25 

02 

2 

2 

3 

69 

19 

8 

24 

02 

1 

1 

1 

58 

17 

9 

33 

03 

14 

4 

1 

67 

19 

10 

34 

04 

12. 

2 

0 

42 

29 

11 

28 

03 

4 

4 

0 

56 

21 

12 

31 

03 

9 

9 

1 

50 

17 

13 

34 

04 

13 

6 

2 

36 

22 

14 

35 

04 

11 

'  6 

0 

55 

26 

15 

25 

03 

3 

1 

0 

57 

22 

16 

33 

04 

10 

1 

0 

52 

15 

17 

28 

03 

6 

2 

1 

68 

22 

18 

31 

03 

11 

10 

2 

51 

21 

19 

25 

03 

4 

2 

1 

55 

23 

20 

28 

03 

4 

4 

0 

73 

21 

21 

25 

03 

4 

4 

2 

63 

17 

22 

24 

01 

2 

1 

0 

57 

12 

23 

26 

03 

3 

3 

3 

56 

22 

24 

32 

03 

11 

1 

1 

49 

19 

25 

27 

03 

5 

5 

4 

73 

22 

26 

27 

03 

6 

4 

0 

65 

19 

27 

30 

01 

12 

0 

63 

24 

Note: 

01  refers  to  a  Second  Lieutenant 
02  refers  to  a  First  Lieutenant 

03  refers  to  a  Captain 

Predictor  Responses  by  Subject 


* 

Subject 

Number 

Predictor 

Age 

Rank-  Years  of 
(see-  Military 
note)  Service 

Years  in  Technical 

Procurement  Training.. 
Field  (total 

courses) 

Individual 

Prominence 

Tolerance 

of 

Disagreement 

28 

32 

03 

10 

10 

2 

63 

22 

29 

33 

03 

14 

A 

0 

64 

18 

30 

29 

03 

7 

6 

1 

66 

28 

31 

24 

02 

1  • 

1 

0 

51 

14 

32 

31 

03 

8 

2 

0 

65 

23 

33 

23 

01 

5 

1 

3 

49 

23 

34 

24 

01 

1 

1 

0 

66 

25 

35 

23 

01 

1 

1 

1 

60 

21 

36 

32 

03 

10 

10 

2 

61 

20 

37 

25 

02 

2 

2 

1 

62 

23 

38 

25 

02 

2 

2 

1 

62 

23 

39 

31 

03 

5 

5 

3 

77 

27 

40 

26 

03 

4 

4 

2 

55 

18 

41 

32 

01 

12 

1 

0 

58 

24 

42 

23 

01 

1 

1 

0 

61 

23 

Note:  01  refers  to  a  Second  Lieutenant 

02  refers  to  a  First  Lieutenant 
03  refers  to  a  Captain 
04  refers  to  a  Major 


BIBLIOGRAPHY 


67 


BIBLIOGRAPHY 


Campbell,  John  P.  et  al.  Managerial  Behavior,  Performance,  and 
-  Effectiveness.  New  York:  McGraw-Hill,  inc.,  1970. 

Charles,  Robert  H.  'Total  Package  Procurement  Concept."  Paper  published 
.  by  the  U.  S.  Government,  Department  of  the  Air  Force.  Washington: 
1966. 

Crandall,  James  E.  "Self  Perception  and  Interpersonal  Attractions  as  Related 
to  Tolerance  -  Intolerance  of  Ambiguity,"  Journal  of  Personality, 

XXXIX  (March  1969  -  December  1969),  ]27^U0. 

Dunnetfe,  Marvin  D.  Personnel  Selection  and  Placement.  Belmont,  Cali¬ 
fornia:  Wadsworth  Publishing  Company,  Inc.,  1966. 

Ferguson,  Leonard  W.  "The  Development  of  Industrial  Psychology,"  in 
Industrial  Psychology,  ed.  B.  von  Haller  Gilmer.  New  York: 
McGraw-Hill,  Inc.,  1961. 

Ghiselli,  Edwin  E.  "  Predictions  of  Success  of  Stockbrokers,  "  Personnel 
Psychology,  XXII  (Summer,  1969)  125  -  130. 

Ghiselli,  Edwin  E.  Theory  of  Psychological  Measurement.  New  York: 
McGraw-Hill,  Inc.,  1964. 

Gossick,  Lee  V.,  Major  General,  USAF,  "Aeronautical  Systems  Division: 

Weapon  Systems  for  Tomorrow's  Air  Force, "  Defense  Industry  Bulletin  , 

VI  (February,  1970)  15-19. 

Guion,  Robert  M.  Personnel  Testing.  New  York:  McGraw-Hill,  Inc.  1965. 

Krug,  Robert  E. ,  "  Personnel  Selection, "  in  Industrial  Psychology,  ed.  B. 
von  Haller  Gilmer,  New  York:  McGraw-Hill,  Inc.,  1961. 

Pace,  DeanF.  Negotiation  and  Management  of  Defense  Contracts.  New 
York:  John  Wiley  &  Sons,  Inc.,  1970. 

Packard,  David.  Memorandum  for  Secretaries  of  the  Military  Departments, 

"Improvements  in  Weapon  Systems  Acquisition."  Washington:  31  July, 
1969. 

Report  to  the  President  and  the  Secretary  of  Defense  on  the  Department  of  De¬ 
fense  by  the  Biuc  Ribbon  Defense  Panel  .  V/asnington:  U.  S.  Government 
Printing  Office,  1970. 


Shaw,  Marvin  E.,  "Behavior  in  Groups:  A  Development  of  a  Scale  to 

Measure  Individual  Prominence,”  in  Decisions,  Values  and  Groups, 
ed.  Dorothy  Wi liner.  London:  Pergamon  Press,  1960. 

Siegel,  Sidney,  Nonparametric  Statistics  for  the  Behavioral  Sciences.  New 
-  York:  McGraw-Hill,  Inc.,  1956^ 

Steffy,  Wilbert  and  Darby,  Daniel  R.,  Performance  Evaluation  Systems. 

.  Ann  Arbor:  University  of  Michigan,  1969. 

U.  S.  Department  of  Defense  Report,,  Fiscal  Year  1972-76  Defense  Program 
and  the  Fiscal  Year  1972  Defense  Budget.  Washington:  U.S. 
Government  Printing  Office,  1 971. 

U.  S.  Department  of  the  Air  Force.  Classification  of  Officer  Speciality, 

AFM  26-1 ,  Washington:  U.  S.  Government  Printing  Office,  1968. 

U.  S.  Department  of  the  Airforce.  Air  Force  Procurement  Career  Development 
Action  Plan  -  Project  Coppercap.  Washington:  unpublished,  1970. 

Williams,  E.  J.  Regression  Analysis.  New  York:  John  Wiley  &  Sons,  Inc., 
1959. 


aflc-wpafb-feb  7i  isoo  Tear  Out 


AFIT  _  POSTAGE  AHD  FEES  PAID  . 

WRiGHT-PATTERSON  AFB.  OH  45433  ;*  ,  DEPARTMENT  OF  THE  AIR  Force' 

- - -  *  •  I 

UNITED  STATES  AIR  FORCE 
OFFICIAL  BUSINESS 


I 


Vp  . 

f 

t 


AFIT/SLGR  * 
Wright-Patterson  AFB 
OHIO  45453 


-  Fold - r - 

The  student  research  conducted  at  this  school  builds,  to  a. great  extent, 
upon  previous  research  efforts.  Thus,  your  comments  and/or  criticism  re¬ 
garding  this  report  are  earnestly  solicited.  PT'ase  fold  the  completed 
sheet  so  the  return  address  is  visible  for  mailing.  COMMENTS: 


i 

i 


i 


-Fold - - ‘ - ' 


i 


i 


i 


i 


i 


